<!DOCTYPE html>
<html prefix="
og: http://ogp.me/ns#
article: http://ogp.me/ns/article#
" lang="zh_cn">
<head>
<meta charset="utf-8">
<meta name="description" content="python, go, ML, bigdata">
<meta name="viewport" content="width=device-width">
<title>vincent blog (旧文章页 1) | vincent blog</title>
<link href="assets/css/all-nocdn.css" rel="stylesheet" type="text/css">
<link rel="alternate" type="application/rss+xml" title="RSS" href="rss.xml">
<link rel="canonical" href="https://wisonwang.github.io/index-1.html">
<!--[if lt IE 9]><script src="/assets/js/html5.js"></script><![endif]--><style>
    div.input_prompt {
      display: none;
    }
    </style>
</head>
<body>
    <section class="social"><ul>
<li><a href="index.html" title="Home"><i class="icon-home"></i></a></li>
            <li><a href="archive.html" title="文章存档"><i class="icon-archive"></i></a></li>
            <li><a href="categories/" title="标签"><i class="icon-tags"></i></a></li>
            <li><a href="pages/about" title="About"><i class="icon-about"></i></a></li>
            <li><a href="rss.xml" title="RSS 源"><i class="icon-rss"></i></a></li>
            <li><a href="https://twitter.com/wisonwang" title="My Twitter"><i class="icon-twitter"></i></a></li>
            <li><a href="https://github.com/wisonwang" title="My Github"><i class="icon-github"></i></a></li>

        </ul></section><section class="page-content"><div class="content" rel="main">
        <div class="post">
            <h1 class="title"><a href="posts/numpy_example/">numpy_example</a></h1>
            <div class="meta">
                <div class="authordate">
                    <time class="timeago" datetime="2018-05-22T16:58:15+08:00">2018-05-22 16:58</time>
</div>
                <div class="stats">
                                <a href="posts/numpy_example/#disqus_thread" data-disqus-identifier="cache/posts/numpy_example.html">Comments</a>


                </div>
            
            </div>
            <div class="body">
                <div tabindex="-1" id="notebook" class="border-box-sizing">
    <div class="container" id="notebook-container">

<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<p>介绍numpy/scipy库的基本用法.</p>
<p class="more"><a href="posts/numpy_example/">更多…</a></p>
</div>
</div>
</div>
</div>
</div>
            </div>
        </div>
        <div class="post">
            <h1 class="title"><a href="posts/%E5%A6%82%E4%BD%95%E6%90%AD%E5%BB%BA%E5%85%8D%E8%B4%B9https%E6%9C%8D%E5%8A%A1/">如何搭建免费https服务</a></h1>
            <div class="meta">
                <div class="authordate">
                    <time class="timeago" datetime="2018-05-15T12:40:51+08:00">2018-05-15 12:40</time>
</div>
                <div class="stats">
                                <a href="posts/%E5%A6%82%E4%BD%95%E6%90%AD%E5%BB%BA%E5%85%8D%E8%B4%B9https%E6%9C%8D%E5%8A%A1/#disqus_thread" data-disqus-identifier="cache/posts/letsencrypt_https.html">Comments</a>


                </div>
            
            </div>
            <div class="body">
                <p>
https 取代http已经是一个趋势了，那么如何才能将自己的web站点支持https呢，或者说有那些免费https ca网站呢。
下面主要介绍通过 <a href="https://letsencrypt.org/">https://letsencrypt.org/</a> 构建https服务。
</p>
            </div>
        </div>
        <div class="post">
            <h1 class="title"><a href="posts/golang%2Ccluster/">golang cluster</a></h1>
            <div class="meta">
                <div class="authordate">
                    <time class="timeago" datetime="2018-05-10T16:36:25+08:00">2018-05-10 16:36</time>
</div>
                <div class="stats">
                                <a href="posts/golang%2Ccluster/#disqus_thread" data-disqus-identifier="cache/posts/golang_cluster.html">Comments</a>


                </div>
                    <div itemprop="keywords" class="tags">
        <ul>
        标签 : 
           <li><a class="tag p-category" href="categories/draft-golang/" rel="tag">draft golang</a></li>
        </ul>
</div>

            </div>
            <div class="body">
                <p>
golang服务的集群方案
</p>
<div id="outline-container-org2c1f1eb" class="outline-2">
<h2 id="org2c1f1eb">服务发现</h2>
<div class="outline-text-2" id="text-org2c1f1eb">
</div>
<div id="outline-container-org09dafda" class="outline-3">
<h3 id="org09dafda">基于zookeeper</h3>
<div class="outline-text-3" id="text-org09dafda">
<p>
<a href="https://www.v2ex.com/t/440662">手把手教你使用 Go 基于 zookeeper 编写服务发现</a>
</p>
</div>
</div>

<div id="outline-container-org61f6f3a" class="outline-3">
<h3 id="org61f6f3a">consul 轻量级服务发现服务</h3>
<div class="outline-text-3" id="text-org61f6f3a">
<p>
<a href="https://www.consul.io/">consul 服务发现</a>
</p>
</div>
</div>
</div>


<div id="outline-container-org80f837c" class="outline-2">
<h2 id="org80f837c">配置中心</h2>
<div class="outline-text-2" id="text-org80f837c">
</div>
<div id="outline-container-org0d45b5b" class="outline-3">
<h3 id="org0d45b5b">apollo配置中心</h3>
<div class="outline-text-3" id="text-org0d45b5b">
<p>
<a href="https://github.com/ctripcorp/apollo">apollo配置中心</a>
</p>
</div>
</div>
</div>
            </div>
        </div>
        <div class="post">
            <h1 class="title"><a href="posts/devops%2Ctools/">devops tools</a></h1>
            <div class="meta">
                <div class="authordate">
                    <time class="timeago" datetime="2018-05-09T15:28:39+08:00">2018-05-09 15:28</time>
</div>
                <div class="stats">
                                <a href="posts/devops%2Ctools/#disqus_thread" data-disqus-identifier="cache/posts/devops.html">Comments</a>


                </div>
            
            </div>
            <div class="body">
                <div id="outline-container-org9a6a38f" class="outline-2">
<h2 id="org9a6a38f">fabric</h2>
</div>

<div id="outline-container-orgb1681ba" class="outline-2">
<h2 id="orgb1681ba">ansible</h2>
</div>

<div id="outline-container-org116d993" class="outline-2">
<h2 id="org116d993">监控</h2>
<div class="outline-text-2" id="text-org116d993">
</div>
<div id="outline-container-orgae64139" class="outline-3">
<h3 id="orgae64139">opentsdb</h3>
</div>
<div id="outline-container-orga48ac4c" class="outline-3">
<h3 id="orga48ac4c">elk</h3>
</div>
</div>
            </div>
        </div>
        <div class="post">
            <h1 class="title"><a href="posts/python_tools/">python_tools</a></h1>
            <div class="meta">
                <div class="authordate">
                    <time class="timeago" datetime="2018-04-28T12:30:35+08:00">2018-04-28 12:30</time>
</div>
                <div class="stats">
                                <a href="posts/python_tools/#disqus_thread" data-disqus-identifier="cache/posts/python_tools.html">Comments</a>


                </div>
            
            </div>
            <div class="body">
                <div id="outline-container-org52ee7f1" class="outline-2">
<h2 id="org52ee7f1">编辑开发工具</h2>
</div>

<div id="outline-container-orgd936521" class="outline-2">
<h2 id="orgd936521">虚拟机</h2>
<div class="outline-text-2" id="text-orgd936521">
</div>
<div id="outline-container-org9d0274b" class="outline-3">
<h3 id="org9d0274b">pyevn + anaconda</h3>
</div>
<div id="outline-container-org141b537" class="outline-3">
<h3 id="org141b537">virtualenv + virtualenvwrapper</h3>
</div>
</div>


<div id="outline-container-org65b72c0" class="outline-2">
<h2 id="org65b72c0">文档工具</h2>
<div class="outline-text-2" id="text-org65b72c0">
</div>
<div id="outline-container-org29abacd" class="outline-3">
<h3 id="org29abacd">sphinx</h3>
</div>

<div id="outline-container-org074c56b" class="outline-3">
<h3 id="org074c56b">pydoc</h3>
</div>
</div>
            </div>
        </div>
        <div class="post">
            <h1 class="title"><a href="posts/scala_sbt_on_spacemacs/">scala_sbt_on_spacemacs</a></h1>
            <div class="meta">
                <div class="authordate">
                    <time class="timeago" datetime="2018-04-23T11:01:45+08:00">2018-04-23 11:01</time>
</div>
                <div class="stats">
                                <a href="posts/scala_sbt_on_spacemacs/#disqus_thread" data-disqus-identifier="cache/posts/scala_sbt_on_spacemacs.html">Comments</a>


                </div>
            
            </div>
            <div class="body">
                <p>
在这里书写你的文章。</p>
            </div>
        </div>
        <div class="post">
            <h1 class="title"><a href="posts/scala_maven_to_sbt/">scala_maven_to_sbt</a></h1>
            <div class="meta">
                <div class="authordate">
                    <time class="timeago" datetime="2018-04-23T11:00:59+08:00">2018-04-23 11:00</time>
</div>
                <div class="stats">
                                <a href="posts/scala_maven_to_sbt/#disqus_thread" data-disqus-identifier="cache/posts/scala_maven_to_sbt.html">Comments</a>


                </div>
            
            </div>
            <div class="body">
                <div id="outline-container-org0e88e34" class="outline-2">
<h2 id="org0e88e34">scala 工程使用sbt还是maven</h2>
<div class="outline-text-2" id="text-org0e88e34">
<p>
<a href="http://www.hammerlab.org/2017/04/06/scala-build-tools/#sbt">
scala by maven or sbt</a>
</p>
</div>
</div>

<div id="outline-container-org6fea7bd" class="outline-2">
<h2 id="org6fea7bd">转换maven为sbt</h2>
<div class="outline-text-2" id="text-org6fea7bd">
<p>
网上有可以直接使用maven pom.xml文件的，sbt插件。新版本sbt可能会提示找不到仓库，可以尝试本地编译。
<a href="https://github.com/shivawu/sbt-maven-plugin">maven转sbt插件</a>
</p>
</div>
</div>
            </div>
        </div>
        <div class="post">
            <h1 class="title"><a href="posts/spark-with-python-or-scala/">使用python还是scala开发spark程序？</a></h1>
            <div class="meta">
                <div class="authordate">
                    <time class="timeago" datetime="2018-04-17T16:16:02+08:00">2018-04-17 16:16</time>
</div>
                <div class="stats">
                                <a href="posts/spark-with-python-or-scala/#disqus_thread" data-disqus-identifier="cache/posts/spark-with-python-or-scala.html">Comments</a>


                </div>
                    <div itemprop="keywords" class="tags">
        <ul>
        标签 : 
           <li><a class="tag p-category" href="categories/pyspark/" rel="tag">pyspark</a></li>
           <li><a class="tag p-category" href="categories/python/" rel="tag">python</a></li>
           <li><a class="tag p-category" href="categories/scala/" rel="tag">scala</a></li>
           <li><a class="tag p-category" href="categories/spark/" rel="tag">spark</a></li>
        </ul>
</div>

            </div>
            <div class="body">
                <div>
<p>
spark 官方提供了python,java, scala,R 三种语言的封装，scala和java都建立jvm可以相互调用，R一般人用的不多，如下比较一下python
和scala开发spark程序的优缺点。
</p>

<div id="outline-container-orgbaf403a" class="outline-2">
<h2 id="orgbaf403a">scala和python开发spark程序各自优点</h2>
<div class="outline-text-2" id="text-orgbaf403a">
</div>
<div id="outline-container-orgef7354b" class="outline-3">
<h3 id="orgef7354b">pyspark优点</h3>
<div class="outline-text-3" id="text-orgef7354b">
<ol class="org-ol">
<li>动态语言开发效率高，工程难度低</li>
<li>算法类库丰富，易于移移植现有算法到spark平台</li>
<li>工具支持丰富，包括jupyter notebook之类的工具，能够做到程序结果可视化，方便调优</li>
</ol>
</div>
</div>

<div id="outline-container-orgdd6c6cb" class="outline-3">
<h3 id="orgdd6c6cb">pyspark缺点</h3>
<div class="outline-text-3" id="text-orgdd6c6cb">
<ol class="org-ol">
<li>性能差： 动态语言载加上通过py4j来和spark交互的，在计算量很大的情况下慢的可怕；</li>
<li>不能使用全部spark api： 因为是通过py4j调用，需要必要的封装（pyspark），不能像scala那样和java可以直接调用， 导致不能直接调用java或者scala类库。</li>
</ol>
<p class="more"><a href="posts/spark-with-python-or-scala/">更多…</a></p>
</div>
</div>
</div>
</div>
            </div>
        </div>
        <div class="post">
            <h1 class="title"><a href="posts/%E4%BD%BF%E7%94%A8nikola%2Bspacemacs%2Borgmode%20%E6%90%AD%E5%BB%BAblog/">使用nikola+spacemacs+orgmode 搭建blog</a></h1>
            <div class="meta">
                <div class="authordate">
                    <time class="timeago" datetime="2018-04-13T20:29:50+08:00">2018-04-13 20:29</time>
</div>
                <div class="stats">
                                <a href="posts/%E4%BD%BF%E7%94%A8nikola%2Bspacemacs%2Borgmode%20%E6%90%AD%E5%BB%BAblog/#disqus_thread" data-disqus-identifier="cache/posts/nikola_spacemacs.html">Comments</a>


                </div>
                    <div itemprop="keywords" class="tags">
        <ul>
        标签 : 
           <li><a class="tag p-category" href="categories/blog/" rel="tag">blog</a></li>
           <li><a class="tag p-category" href="categories/emacs/" rel="tag">emacs</a></li>
           <li><a class="tag p-category" href="categories/nikola/" rel="tag">nikola</a></li>
           <li><a class="tag p-category" href="categories/spacemacs/" rel="tag">spacemacs</a></li>
        </ul>
</div>

            </div>
            <div class="body">
                <div id="outline-container-orga322129" class="outline-2">
<h2 id="orga322129">使用nikola+spacemacs搭建blog</h2>
<div class="outline-text-2" id="text-orga322129">
<p class="more"><a href="posts/%E4%BD%BF%E7%94%A8nikola%2Bspacemacs%2Borgmode%20%E6%90%AD%E5%BB%BAblog/">更多…</a></p>
</div>
</div>
            </div>
        </div>
        <div class="post">
            <h1 class="title"><a href="posts/word2vec/">word2vec</a></h1>
            <div class="meta">
                <div class="authordate">
                    <time class="timeago" datetime="2018-04-13T17:55:51+08:00">2018-04-13 17:55</time>
</div>
                <div class="stats">
                                <a href="posts/word2vec/#disqus_thread" data-disqus-identifier="cache/posts/word2vec.html">Comments</a>


                </div>
            
            </div>
            <div class="body">
                <p>
在这里书写你的文章。
</p>
            </div>
        </div>
            <nav class="postindexpager"><ul class="pager">
<li class="previous">
                <a href="index-2.html" rel="prev">新一篇</a>
            </li>
        </ul></nav><script>var disqus_shortname="wisonwanghomepage";(function(){var a=document.createElement("script");a.async=true;a.src="https://"+disqus_shortname+".disqus.com/count.js";(document.getElementsByTagName("head")[0]||document.getElementsByTagName("body")[0]).appendChild(a)}());</script><footer id="footer"><p>Contents © 2020         <a href="mailto:fangfu2012@gmail.com">vincent wang</a> - Powered by         <a href="https://getnikola.com" rel="nofollow">Nikola</a>         </p>
            
        </footer>
</div>
    </section><script src="assets/js/all-nocdn.js" type="text/javascript"></script><script type="text/javascript" src="https://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML"> </script><script type="text/x-mathjax-config">
    MathJax.Hub.Config({tex2jax: {inlineMath: [['$latex ','$'], ['\\(','\\)']]}});
    </script><script type="text/javascript">
            $(function(){
                $('.timeago').timeago();
            });
        </script>
</body>
</html>
